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Abstract 



Ch ! The occurrence of the nonzero leftmost digit, i.e., 1, 2, ..., 9, of num- 

I I bers from many real world sources is not uniformly distributed as one might 



naively expect, but instead, the nature favors smaller ones according to a 

logarithmic distribution, named Benford's law. We investigate three kinds of 

lyj . widely used physical statistics, i.e., the Boltzmann-Gibbs (BG) distribution, 

^ ! the Fermi-Dirac (FD) distribution, and the Bose-Einstein (BE) distribution, 

^1 and find that the BG and FD distributions both fluctuate slightly in a peri- 

r-| ' odic manner around the Benford distribution with respect to the temperature 

, ^-f - of the system, while the BE distribution conforms to it exactly whatever the 

temperature is. Thus the Benford's law seems to present a general pattern 

for physical statistics and might be even more fundamental and profound in 

O ! nature. Furthermore, various elegant properties of Benford's law, especially 

^2 ' the mantissa distribution of data sets, are discussed. 
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1. Introduction 



One may simply presume that occurrence of the first digit of any randomly 
chosen data set is approximately uniformly distributed, but that is not the 
very case in real world. In 1881, Newcomb [l| noticed that the preceding 
pages of the logarithmic table wear out faster, thus he hinted at the idea 
that the first nonzero digit of many natural numbers favors small values, 
where the number 1 appears almost seven times more often than that of 
the number 9. Then independently in 1938, Benford |2| investigated a great 
number of data sets in various unrelated fields, and found that they agree 
with a logarithmic distribution, which now we refer to as Benford's law after 
the name of its second discoverer, 



PBenid)=log,,{l + -),d = l,2,...,9 



(1) 



where PBenid) is the probability of a number having the first digit d. It is 
also named the first digit law or the significant digit law. 

The discoveries of various samples from different domains that comply 
with Benford's law are accumulating significantly all these years. Empiri- 
cally, the areas of lakes, the lengths of rivers, the arable numbers on the 
front page of a newspaper [2l], physical constants |3|, the stock market in- 
dices \^ , file sizes in a personal computer |5| , survival distributions |6| , widths 
of hadrons Tjl, various quantities of pulsars [8| , even some general dynamical 
systems J9|, [lO|, luf, all conform to the peculiar law well. Nevertheless, there 
also exist other types of data which do not obey the law, e.g., lottery and tele- 
phone numbers. Unfortunately, there is no a priori criteria yet to judge which 
type a data set belongs to. In practice, the law is already applicable in dis- 
tinguishing and ascertaining fraud in taxing and accounting 12|, |l3|, [ij, Il5| . 
as well as speedin g up calculation and minimizing expected storage space in 



16, 17, 18 



computer science 

Since its second discovery in 1938, many attempts have been tried to 
explain the underlying reason for Benford's law. For theoretical reviews, 

and Hill 



20, 21, 22 



see papers written by Raimi [19 

Nowadays, many breakthrough points have been achieved 



23, 24, 25, 26, 27 



still lacks a universally accepted final answer. 

law is the only digit law that is scale-invariant 

law does not depend on any particular choice of units, first discovered by 



though, there 
In mathematics, Benford's 
28 , which means that the 



Pinkham 29 . Benford's law is also base- invariant 23, 24, 25 1, which means 



that it is independent of the base b. In the binary system {b=2), octal system 
(6=8), or other base system, the data, as well as in the decimal system (6=10), 
all fit the general Benford's law, 

PBen(rf)=l0gb(l + i),rf=l,2,...,6-l. (2) 

Theoretically, Hill proved that "scale-invariance implies base-invariance" [23| 



and "base-invariance implies Benford's law" J2J| mathematically in the frame- 
work of probability theory. 

It was suggested that "an interesting open problem is to determine which 



common distributions (or mixtures thereof) satisfy Benford's law" [25|]. To 
track the suggestive idea p] and explore more aspects of the peculiar law in 
general physics, we study comprehensively three kinds of widely used physical 
statistics in this paper, i.e., the Boltzmann-Gibbs (BG) distribution, the 
Fermi-Dirac (FD) distribution, and the Bose-Einstein (BE) distribution. We 
find that the BG and FD distributions both fluctuate slightly in a periodic 
manner around the Benford distribution with respect to the temperature of 
the system, while the BE distribution conforms to it exactly, independent of 
the temperature of the system. In some sense, the logarithmic distribution 
presents a general feature in statistical physics. Thus it seems that the 
significant digit law takes precedence over physical statistics, and it might 
be a more fundamental principle behind the complexity of the nature. There 
are other sorts of regularities very interesting and not totally understood 
yet |30|. Before entering to the details of three statistics, we discuss the 
mantissa distribution firstly in the following section, as it is a closely relevant 
and vital issue to Benford's law. 

2. Probability Density of Mantissa 

The mantissa m G (—1, — 0.1] U [0.1, 1) is the significand part of a 
floating-point number x, defined uniquely as x = m x 10", where n is an 
integer. In this paper, if not noted explicitly, we always postulate that the 
numbers are positive for succinct statement. 

Benford's law was stated as that "the law of probability of the occur- 
rence of numbers is such that all mantissae of their logarithms are equally 
likely" [l| . In other words, if we express the mantissa { m } of a data set into 
the form { 10* } where t G [ — 1, ), then { t } is uniformly distributed. 



The above statement is sufficient to Benford distribution, however, it is 
not indispensable to Eq. ([T]) and Eq. ([2]). Actually, the uniform distribution 
of the logarithm of mantissa |2J] is equivalent to the ra-digit Benford's law. 



PBenidi,d2,...,dn) = log 



10 



1+K^rf, 



X 10^ 



, j=l 



(3) 



where dn is the n-th leftmost digit, hence di E { 1,2,..., 9 } and dn G 
{ 0, 1, 2, ..., 9 } for n > 2. For instance, the probability of finding a num- 
ber with the first two digits di = 1 and d2 = 5 is PBcn{di = 1,(^2 = 5) = 
logio(l + 1/15) = 2.80%. 

Under the assumption that the logarithm of mantissa is uniformly dis- 
tributed, it is direct to attain the normalized probability density of mantissa. 



/(m) 



1 1 

— , mG [0.1, 1 



In 10 m 



(4) 



which was also achieved by Lemons in terms of a probabilistic model of parti- 
tioning a conserved quantity 3l| and Pietronero et al. using processes where 



the time evolution is governed by multiplicative fluctuations [32|. We sus- 
pect that the probability density of mantissa, i.e., Eq. (jl]), might be a crucial 
insight to understand Benford's law in the framework of probability theory 
or statistical analysis. However, the generally mathematical manipulation 
of the mapping from real data sets to mantissa sets is hard to deal with. 
Difficulties notwithstanding, mantissa distributions induced by distributions 
on M have been studied extensively 2J, |28 . 



3. Physical Statistics and Benford's Law 

In statistical physics, the BG distribution, the FD distribution, and the 
BE distribution are three kinds of widely used canonical statistics, and have 
extensive applications in various domains of physics. On the other hand, 
many physical samples are found to reproduce the Benford distribution em- 
pirically. Therefore it is speculated naturally that these Benford samples 
might present some general characteristics originating from physical statis- 
tics. It seems very intriguing to look into the relationship between canonical 
statistics and Benford's law. 

To relate physical statistics to Benford's law quantitatively, we refer to 



the language of probability density. Assuming a measurable quantity, for 
example, the energy E, has its normalized probability density f{E), where 
-E e (0, + cxd), then the probability that the energy E has its significant 
digit d equals to 

P{d) = Y, / f{E)dE (5) 

which will be utilized frequently in the following analysis. 

Throughout the whole paper, we use the energy E of the system as the 
measurable quantity, whose first digit distribution is compared with Ben- 
ford's law as an example. However, the situation should not be limited to 
this special case. Since many quantities are distributed in the same form as 
or a similar form to the energy E, the results can be extended without any 
difficulty. The method can further be extended easily to analyse other kinds 
of distributions as well. 

3.1. The Boltzmann-Gibbs distribution 

The Boltzmann-Gibbs (BG) distribution applies to particles under the 
classical circumstances where quantum effects can be ignored. It was dis- 
covered by Boltzmann in 1877 j33|, and significantly developed by Gibbs in 
1901 [3^, and since then, it plays a fundamental role throughout statistical 
physics as a milestone. 

To be more specific, for a thermal bath at a well-defined temperature T, 
the Boltzmann-Gibbs statistics gives the normalized probability density, 

fBG{E) = (3e-^^ (6) 

where /3 = 1/kT, and k is the Boltzmann constant. Eq. ([6]) can be derived 
directly from Liouville's theorem. 

Utilizing Eq. ([S]), we can immediately obtain the probability of E with 
its first nonzero digit d, 

oo 

PBG{d-^)= Yl [e-^-^-^o" - e-^('^+^)-i°n (7) 



which is a function of both /3 and d. It was easily noticed that PBcid', P) > 
-Pbg(c^ + 1; /3) after factorizing the summed term into the form of e~^'^'^°"(l — 
g-/3io"^ It reproduces the rough property of the first digit law qualitatively 



thereof. 

Further from Eq. ([7]), it is straightforward to check an important fact that 



PBG{d\P) = PBG{d\lQP). 



(8) 



It was recognized in the exponential random variables by Engel and Leuen- 
berger [35|. This property leads to a periodic function of PBcid; B) on the 
/3-logarithmic scale, illustrated in Fig. [1] (also see Figure 1 in Ref. [35|). The 
horizontal line in each panel is the value predicted by Benford's law. It is 
shown clearly that the first digit distributions of the BG distribution con- 
form to Benford's law approximately, and fluctuate around it slightly. The 
variation is within the bound of 0.03 for number 1 35 , and smaller for other 



digits. The maximum deviations and the maximum relative deviations are 
listed in Table [H 

Furthermore, a new function P^Q^d; a) is defined as P^Q^d; a) = Pscid; (3 ■ 
lO'^), which is a 1-periodic function with respect to a, i.e., P^Q{d;a) = 
P%Q{d;a + 1). Then it was proved that the Fourier coefficient cq of the 
Fourier series P^Q^d] a) = ^^ c^e*'^"'^" equals exactly to log]^o(l + ^/d), thus 
the integral mean of P^Q^d] a) follows Benford's law [35j 



P^Q^d; a)da 



logio(l 



i) = PBcnid). 



(9) 



However, the underlying assumption that a = log^g (3 is uniformly distributed 
appears indiscretionary from the standpoint of statistical physics. 

3.2. The Fermi-Dirac distribution 

Empirically, not only data sets rooting in macrocosmic systems, but also 
those in microcosmic systems obey Benford's law, e.g., widths of hadrons [TJ, 



half-lives of a-decays [36|, |37l], and the strengths of electric-dipolar lines in 
transition arrays of complex atomic spectra (38'] . Therefore, it is also neces- 
sary to study the first digit distributions of quantum statistics. 

The Fermi-Dirac (FD) distribution was proposed by Fermi in 1926 for 
electrons 
later 



39 



40 



and its relation to quantum mechanics was elucidated by Dirac 
It is the statistics obeyed by particles that are described by an- 
tisymmetrical wave function with half-integral spin, where Pauli principle 



applies, and the normalized probability density is 



(10) 



In 2 e^^ + 1 ■ 
Utilizing Eq. (jS]), it is straightforward to obtain the desired probability. 



PMd;P)= Yl r^<^/3-io" + in 



^I3d-10" 



+ 1 



3^(d+l)-10" _^ I 



:ii) 



and results are shown in Fig. [21 where the horizontal line in each panel 
presents the value predicted by Benford's law. 

The features of the probability functions are astonishingly similar to the 
BG case, with the first digit distributions fluctuating slightly around the 
Benford value. However, the variations are somehow larger than the BG 
distribution, within the bound of 0.045 for number 1, and smaller for other 
numbers. The maximum deviations and the maximum relative deviations 
are listed in Table [TJ 

In addition, the useful identity Ppoid', P) = PpDid; 10/3) still holds in the 
FD statistics, thus the fluctuation here is periodic in the /3-logarithmic scale 
too. We claim that this property should be a general conclusion originating 
from the multiplicative appearance of f3 and d in Eq. (j6]) and Eq. ( ITOj) . 

Similarly, we define Ppjj{d;a) = PpD^d; 13 = 10"), which is a 1-periodic 
function with respect to a. Then the Fourier coefficient Cq of the Fourier 
series Pp^{d; a) = Ylm^n^^'^^^"' equals to 



Co 



Ppjj{d] a) da 



:i2) 



I oo 



V - — <^ 10"+" + In 



n=— oo 

oo -1 



In 2 



10° + In 



gd.lO"+" + 1 
g(d+l)-10"+" _^ I 



da 



1 



,0 In 2 -In 10 

F{d) 



M + In 



g(d+l).10" _^ I 



da 



d-u _|_ 1 



e(rf+i)-« + 1 



u 



where a transformation u = 10" is adopted in calculation, and cq is denoted 



as a function F{d) versus the variable d. 

It is checked that the derivative of F{d) is 

F'{d) = -^ (^- - -}\ , (13) 

^ ' \nm\l + d dj ' ^ ^ 

and the normahzation condition is X]d=i -^('^) — 1; ^^^^ '^o = F{d) = 
log]^o(l + ^/d), which is the precise form of Benford's law again. It leads 
to the conclusion that the integral mean of Ppjj{d; a) also follows the signif- 
icant digit law, i.e., 

f' 1 

/ Pp^{d;a)da = \og,Q{l + -) = PBen{d). (14) 

3.3. The Bose-Einstein distribution 

The Bose-Einstein (BE) distribution was introduced by Bose in 1924 |4l|, 
and generalized by Einstein [4^. It is the statistics obeyed by particles that 
are described by symmetrical wave function with integral spin. Its well- 
known probability density is 

fBE{E) (X ^^^ (15) 

which can not be normalized to unity however. The divergence occurs when 
E approaches zero, where the behavior of JbeIE) tends to be 1/E. The 
main (and also total) contribution comes from the divergent region around 
the singularity E = where fpD — ^ l/E. Consequently, the first digit 
distribution approaches precisely to the n-digit Benford's law according to 
Eq. (jll) and discussions in Section [2] (also see Ref. |24|)- Thus we claim that 
the BE statistics follows Benford's law exactly. 

4. Discussion 

In Fig. [31 we illustrate graphically the maximum deviation. Max \AP{d)\, 
and the maximum relative deviation. Max \AP{d)/PBen{d)\, for the BG dis- 
tribution and the FD distribution. From the figure, we find that the absolute 
value of the maximum deviation decreases monotonously as a function of d, 
while the maximum relative deviation increases versus d. They both ap- 
proach to a steady constant individually. The maximally deviated values of 
BG statistics are always smaller than those of FD statistics. 

8 



Here we do not hope to mislead readers, actually, the variations from 
Benford's law are always beneath the illustrated maximum deviations, and 
the maximum deviations never appear simultaneously for different digits. 
The total distance D{(3) defined as 



D{(3) 



\ 



^[P(t/;/3)-PBen(rf)f (16) 



d=l 



for BG and FD statistics versus temperature is depicted in Fig. HI They both 
have a wavy shape with the same periodicity as the first digit distributions. 
We can see again that D{f3) of BG statistics, within the bound of 0.035, is 
always smaller than that of FD statistics, which is in the range of 0.035-0.055. 
As shown and discussed above (cf. Fig. [3] and Fig. Hj), from the measured 
data sets based on the BG or FD statistics, the variations are rather small, 
even not significant enough to distinguish from the Benford distribution if the 
sample is not sufficiently large. When estimating the fitness of the observed 
probability distribution Pohs{d) to the theoretical one PBen{d), we use fitness 
estimating x^, namely Pearson x^, 

x\n-l) = yNx lPoUd)-PBonid)]' 



where N is the size of the sample and here in our question ra = 9. In Eq. ([Tj 
the degree of freedom is 9 — 1 = 8, and under the confidence level 95%, 
X^(8) = 15.507. The minimum sizes of the samples required to distinguish 
the first digit distributions of BG and FD statistics from Benford's law are 
illustrated in Fig. |5l under the confidence level 95% and the assumption that 
the sample is virtually distributed exactly following Eq. ([6]) and Eq. (TTOj) . 
Since the BG distribution follows Benford's law more closely than the FD 
distribution, its minimum size of the sample required to make a distinction 
from the Benford distribution is larger thereof, more than two times of that 
for the FD distribution. However, the desired samples are more than one 
or several thousands for both cases to tell the difference, and even larger 
when the criterion is made more strict, e.g., under the confidence level 90%. 
Because of the limitation to collect data, it appears somehow unavailable 
under most conditions to judge between the Benford distribution and physical 
statistics at a given temperature. 



Moreover, due to the variation of temperature T and hence (3 (cf. su- 
perstatistics 43| for an example), the difference is further smoothed down. 
Then, in real world, the distributions strictly obeying the BG statistics or FD 
statistics are supposed to appear as the Benford distribution within rather 
good precision or in an exactly way. 

We now return to the 20 different tables consisting of over 20,000 entries 
investigated extensively by Benford |2|. Though Diaconis and Freedman 



provided evidence that Benford had manipulated round-off errors [4^, the 



raw data are also a remarkably good fit. However, Raimi pointed out that. 



"what came closest of all, however, was the union of all his tables" [20||. The 
combination of data from various unrelated domains can give a marvelously 
perfect fit to Benford's law. An important breakthrough motivated by it was 
achieved by Hill in 1995. He proved that "if distributions are selected at 
random (in any 'unbiased' way) and random samples are then taken from 
each of these distributions, the significant digits of the combined sample 
will converge to the logarithmic (Benford) distribution" 



25 . As for our 



study, the first digits of different samples picked from different systems at 
different temperatures are expected to converge to the intermediate value or 
the integral mean, P{d) = log]^o(l + ^/d), which is exactly Benford's law. 

The inclusion of chemical potential n has some influence on the numerical 
results, except for the BG distribution where the effect is exactly canceled out 
by the normalization requirement. Here in our paper, we only preliminarily 
considered the case fi = for simplicity. For the non- vanishing fi, the chem- 
ical potential can depend on the temperature, and a concrete calculation is 
needed. As a simple case study, we adopt 



f{E)^ 



1 



z^E±. 



(18) 



where plus and minus signs correspond to FD and BE distributions respec- 
tively, and z = e'^'^ is the fugacity. Then P{d; /3, z) becomes 



P{d;P,z)= J2 



\n{l±z) 



(3 ■ 10" + In 



3/3(d+l)-10" -^ 2 



(19) 



which is very similar to Eq. (II ip . Relevant properties discussed before, as 
well as the conformance to Benford's law, are all preserved. Moreover, for 
the BE distribution where /x can only take a non-positive value, hence z < 1, 



10 



the distribution converges accordingly. 

The last points we stress are the two most important features of Ben- 
ford's law which contribute to make it so famous, namely, scale-invariance 
and base-invariance. For scale-invariance, the change of unit of the energy 
E in our study equals to rescale the temperature T or the inverse temper- 
ature p. As mentioned, the multiplicative appearance of /3 and E leads to 
the periodic property with respect to the logarithm of /3. Thus the scale 
transformation might equivalently change (3, but not the global probability 
distribution, especially, the intermediate value and the integral mean. As for 
base-invariance, we stress that the analysis in this paper does not depend on 
the base b very much. However, as noted in Ref. |35| for exponential random 
variables (in our study, corresponding to the BG distribution), larger b will 
result in larger variations. 

5. Summary 

Statistical physics underpins the concept of ergodicity, which means that 
all accessible microstates are equiprobable over a long period of time, and the 
cooperative effects and nonlinear dynamics are important to lead to sufficient 
statistics. On the other hand, a peculiar digit law, named Benford's law, 
concerns the digit statistics in various domains, and elegantly presents the 
complicated dynamics and global regularities of the nature in its compact 
formula. 

We relate Benford's law with three kinds of extensively used physical 
statistics, i.e., the Boltzmann-Gibbs statistics, the Fermi-Dirac statistics, 
and the Bose-Einstein statistics. It is found that all three distributions fluc- 
tuate slightly around or exactly conform to the Benford distribution, and 
their intermediate values and the integral means converge to Benford's law 
exactly. It seems that the Benford distribution is a general pattern in statis- 
tical physics. Thus it turns out that Benford's law might be a more profound 
and fundamental law than those in physical statistics, especially in the fields 
where thermal statistics, even nonthermal statistics, is invalidated, where 
Benford's law still applies well. Moreover, the details of the mantissa dis- 
tribution are also discussed, and we suggest that the inverse distribution of 
mantissa might present an important clue to look into deeper reasons and 
crucial aspects of the logarithmic digit law. 

For the moment, the Benford's law has been studied mainly mathemat- 
ically, but not so much physically. We need to understand more physical 

11 



significance of tliis law, and a central concerning is when it works and when 
it does not, and the underlying reason why it works. Further researches are 
needed to understand more aspects of this significant digit law, which has 
revealed a mysterious regularity in the realistic world and remains elusive for 
more than one hundred years. 
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Figure captions 

• Figure 1: The comparisons of the first digit distributions for BG dis- 
tribution and Benford's law via the inverse of temperature (3 = 1/kT, 
where k is the Boltzmann constant. The horizontal line in each panel 
presents the value predicted by Benford's law (also see Figure 1 in 
Ref. H)- 



Figure 2: The comparisons of the first digit distributions for FD dis- 
tribution and Benford's law via the inverse of temperature /3 = 1/kT, 
where k is the Boltzmann constant. The horizontal line in each panel 
presents the value predicted by Benford's law. 

Figure 3: Upper panel: The maximum deviation of the first digit 
distributions from Benford's law for the BG distribution (squared) and 
the FD distribution (star-shaped); Lower panel: the maximum relative 
deviation of the first digit distributions from Benford's law for the BG 
distribution (squared) and FD distribution (star-shaped). 

Figure 4: The distances of the first digit distributions of BG and FD 
statistics from Benford's law versus the inverse temperature /3 = 1/kT. 

Figure 5: The minimum sizes of samples required to distinguish the 
first digit distributions of BG (lower panel) and FD (upper panel) 
statistics from Benford's law versus the inverse temperature f3 = 1/kT, 
under the confidence level 95%. 
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Table 1: The maximum deviations of the first digit distributions from Benford's law for 
the BG distribution and the FD distribution. 



d 


PBcnid) 


Max \AP{d) 


Max AP(rf)/PBcn(rf)| 


First Digit 


Benford 


BG 


FD 


BG 


FD 


1 


0.301 


0.0291 


0.0435 


9.66% 


14.5% 


2 


0.176 


0.0187 


0.0281 


10.6% 


15.9% 


3 


0.125 


0.0136 


0.0204 


10.9% 


16.3% 


4 


0.097 


0.0107 


0.0160 


11.0% 


16.5% 


5 


0.079 


0.0088 


0.0131 


11.1% 


16.6% 


6 


0.067 


0.0074 


0.0111 


11.1% 


16.6% 


7 


0.058 


0.0064 


0.0097 


11.1% 


16.7% 


8 


0.051 


0.0057 


0.0085 


11.1% 


16.7% 


9 


0.046 


0.0051 


0.0076 


11.1% 


16.7% 
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Figure 1: The comparisons of the first digit distributions for BG distribution and Bcnford's 
law via the inverse of temperature /3 — 1/kT, where k is the Boltzmann constant. The 
horizontal line in each panel presents the value predicted by Benford's law (also see Figure 
1 in Ref. M 
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Figure 2: The comparisons of the first digit distributions for FD distribution and Benford's 
law via the inverse of temperature /3 — 1/fcT, where k is the Bohzmann constant. The 
horizontal line in each panel presents the value predicted by Benford's law. 
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Figure 3: Upper panel: The maximuni deviation of the first digit distributions from Ben- 
ford's law for the BG distribution (squared) and the FD distribution (star-shaped); Lower 
panel: the maximuni relative deviation of the first digit distributions from Benford's law 
for the BG distribution (squared) and the FD distribution (star-shaped). 
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Figure 4: The distances of the first digit distributions of BG and FD statistics from 
Benford's law versus the inverse temperature /3 — 1/kT. 
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Figure 5: The minimum sizes of samples required to distinguish the first digit distributions 
of BG (lower panel) and FD (upper panel) statistics from Benford's law versus the inverse 
temperature /3 = ^/kT, under the confidence level 95%. 
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